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ABSTRACT 


Multichannel  image  decoding  is  a very  general 
scheme  to  improve  the  signal-to-noise  ratio  in  decoding 
images  coded  with  linear  shift  invariant  codes.  It  is  shown 
that  it  can  be  advantageous  to  code  an  image  with  more  than 
one  code.  A “composite"  inverse  filter  can  then  be  used  in 
the  frequency  plane  to  recover  the  Fourier  transform  of  the 
original  image.  To  recover  a particular  point  in  the  frequen- 
cy plane,  the  inverse  filter  for  any  one  of  the  coded  versions 
of  the  image,  that  is  any  channel,  can  be  used.  The  channel 
with  the  highest  signal-to-noise  ratio  is  used  to  recover  the 
desired  point.  A particular  application  of  this  scheme  is 
examined.  A two-channel  code  is  compared  with  a one- 
channel  code  in  the  frequency  domain  for  the  case  of  mis- 
focus  blurring.  A graphical  analysis  is  given  which  ccpmpares 
the  distance  in  the  frequency  plane  up  to  the  first  zero  in  the 
restored  transfer  function  for  one-  and  two-channel  deblurring. 
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Binary  plots  of  the  restored  transfer  functions  for  a dynamic 
range  of  100  are  shown  for  the  two  different  coding  schemes. 
These  plots  show  that  the  two-channel  code  recovers  37% 
more  area  in  the  frequency  plane  than  the  one-channel  code. 
This  increased  area  restores  information  missing  near  zeros 
in  the  one-channel  transfer  function.  An  optical  simulation 
was  made  using  the  binary  plots  as  frequency  plane  filters. 
Using  photographs  of  subjects  with  a significant  amount  of 
line  and  edge  structure#  it  is  shown  that  the  two-channel 
code  results  in  "sharper"  decoded  images. 
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CHAPTER  1 
INTRODUCTION 

It  is  the  purpose  of  this  chapter  to  define  the  coded 
image  in  terms  of  a linear  mapping.  The  particular  case  of 
an  image  coded  with  a linear  shift  invariant  mapping  will  be 
discussed.  A brief  review  of  past  research  on  coding  and 
decoding  is  included.  The  recent  research  on  inverse  filter- 
ing will  be  of  special  interest  in  Chapter  3 . The  scope  of  this 
report  and  its  important  contributions  are  summarized 
at  the  end  of  this  chapter. 

1 . 1 THE  LINEAR  SPACE  INVARIANT  CODE 

Consider  the  situation  shown  in  Fig.  1.  A planar 
radiant  object  lies  in  the  x^^  - y^  plane.  The  intensity  dis- 
tribution s(x^,y^)  is  mapped  by  some  arbitrary  image  coding 
system  into  the  x^  - y ^ plane.  At  this  plane  a coded  image 
g(x2 ,Vy)  is  formed.  The  image  coding  system  is  similar 
to  the  "black  box"  used  in  linear  circuit  analysis,  where  s 


J 


1 


3 


and  g represent  the  input  and  output  of  the  box  respectively. 

This  coding  system  could,  for  example,  physically  refer  to  some 

arrangement  of  lenses  and  apertures  or  some  random  process 

such  as  an  optically  turbulent  atmosphere  through  which  a 

coded  image  g(x2,y2)  is  obtained.  This  coded  image  is  usually 

blurred  or  distorted  and  its  intensity  distribution  differs  from 

s(x2»yj)»  In  a very  general  case  the  mapping  from  s to  g 

may  be  described  by1 
+ 00 

g(x2'y2)  =ffh[X l'yl  Vy2'  s(xi'yi)]  . (1  ~ 1) 

— 00 

Here  the  function  h is  called  the  "impulse  response". 

Equation  (1  - 1)  describes  a very  arbitrary  nonlinear  mapping. 
Fortunately  in  many  important  cases  the  mapping  is  considerably 
simpler  in  practice.  If  the  impulse  response  can  be  used  to 
weight  the  object  distribution  and  the  coded  image  can  be 
represented  as  a weighted  sum  (or  integral  in  the  continuous 
case)  over  sfx^y^),  then  the  following  relation  exists  between 
g(xJ,y1)  and  s(x2,y2): 


w 

g(X2'y2}  =ffh  (xi'yi'  x2'y2}  S<V>V  dxidyi  {1  _ 


2) 
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Equation  (1  - 2)  represents  a linear  mapping  between  s and  g. 
The  intensity  distribution  g(x^,y^)  is  the  superposition  of  the 
impulse  response  from  every  point  of  s(x^,y^).  However,  even 
the  relationship  described  in  (1  - 2)  is  quite  complicated,  and 
in  many  cases  of  practical  interest  an  additional  simplification 
can  be  made: 

h(x  ,ylfx2,y2)  = hfXj-x^  y^yj) . (1-3) 

In  this  case  the  system  is  said  to  be  space-invariant.  This 
is  analogous  to  time  invariance  associated  with  linear  circuit 
analysis.  Equation  (1  - 3)  assumes  that  translating  the  input 
intensity  distribution  s causes  the  output  g to  be  translated 
in  direct  proportion.  It  will  be  assumed  in  what  follows  that 
only  linear  space  invariant  systems  will  be  used  in  coding. 

1.2  THE  TWO-DIMENSIONAL  FOURIER  TRANSFORM 

The  linear  space-invariant  optical  system  like  time- 
invariant  electrical  systems  is  easy  to  discuss  in  the  Fourier 
transform,  domain.  To  handle  two-dimensional  variables,  a 
two-dimensional  Fourier  transform  is  used.  (This  can  be 


5 


derived  directly  from  the  definition  of  a one-dimensional 
2 

transform.  ) The  two-dimensional  Fourier  transform  pair 

associated  with  the  function  g(x,y)  is  F(g)  where 
+ ® 

F{g)  =^fg(x,y)  exp  [-J2tt  (x§  + yT))]  dxdy  . (1-4) 

~ 00 

Here,  the  expression  "expftt))"  is  used  for  e10.  The  Fourier 
transform  F(g)  is  the  function  G(§,  T)) , where  5 and  1)  are 
rectangular  coordinates  in  the  frequency  domain  and  are  referred 
to  as  frequency  variables  or  simply  frequencies.  Either  g or 
G can  be  used  as  an  adequate  description  of  an  intensity 
distribution.  The  intensity  distribution  is  rep  resented  by 
either  function;  g(x,y)  is  referred  to  as  the  space  domain  des- 
cription. Given  the  frequency  domain  description  GT 5,  *1)',  then 
g(x,y)  can  be  found  in  the  space  domain  using  the  two-dimen- 
sional inverse  Fourier  transform: 

+00  _ 
g(x,y)  =/y*G(§,  11)  exp[j2TT  (x§  + yTDjd  § dT]  . (1-5) 

• 00 

The  function  g must  satisfy  Dirichlet  conditions  for  Eqs.  (I  - 4) 

and  (1  - 5)  to  be  meaningful.  However,  if  a function  is  phys- 

3 

ically  possible,  this  is  a sufficient  condition.  The  problem 
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in  using  the  definitions  given  in  (1  - 4)  and  (1  - 5)  usually 

occurs  when  the  physical  situation  is  only  approximately 

modeled  using  idealizations  such  as  the  Dirac  6 function. 

These  situations  usually  require  an  interpretation  in  terms  of 

generalized  functions.  These  pathological  anomalies  will  be 

ignored  in  discussions  which  follow,  and  instead  the  reader 

4,5 

is  referred  to  works  including  a more  advanced  discussion. 
Results  from  Fourier  analysis  will  be  used  freely  without  going 
into  proofs  of  theorems. 

One  of  the  most  useful  theorems  in  respect  to  linear 
system  theory  is  the  convolution  theorem.  If  the  convolution 
of  two  functions  s and  h is  g , then 

+ oo 

g (x , y)  = JJ s(x,y)  h(x'-x,  y '-y)  dx'dy'.  (1  - 6) 

" 00 

This  may  be  written  in  a more  compact  notation  using  an  aster- 


ick  to  indicate  convolution: 


g = s * h 


' (1  - 7) 


Note  that  the  convolution  integral  (1  - 6)  is  equivalent  to  a 
linear  space-invariant  mapping  of  s to  g.  The  convolution 


7 


theorem  states  that  this  mapping  may  be  described  as  a product 
in  the  frequency  domain: 

G = H S . (1-7) 

The  upper-case  variables  G,  H,  and  S represent  the  Fourier 
transforms  of  the  lower-case  variables  g,  h,  and  s,  respec- 
tively. In  Eq.  (1  - 7) , H is  referred  to  as  the  transfer  function. 
If  the  mapping  from  s to  g is  a coding  operation,  then  H is 
called  the  "coding"  transfer  function.  The  relationship  between 
Eqs.  (1  - 6)  and  (1  - 7)  will  prove  quite  useful  later  when  the 
decoding  process  is  discussed. 

1.3  PAST  RESEARCH  ON  CODING  AND  DECODING 

In  this  section,  coding  and  decoding  will  be  put  in 
its  historical  perspective.  The  brief  review  given  here  covers 
coding  from  a more  general  viewpoint.  It  should,  however, 
give  a good  idea  of  the  relationship  of  the  main  topic  of  this 
report  to  previous  research. 


1*3.1  Bragg  Imaging, Holography,  and  Crystallography 

Historically  the  earliest  attempts  using  o coding- 
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i 


[ 
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decoding  process  was  one  used  by  Bragg  ' . As  early  as 
1929  he  produced  images  of  crystal  structure.  Bragg  was  able 
to  obtain  the  amplitude  of  Fraunhoefer  patterns  from  X-ray  dif- 
fraction data.  The  Fraunhoefer  pattern  is  equivalent  to  the 
Fourier  transform  of  the  atomic  diffracting  structure.  This 
may  be  viewed  as  a coded  version  of  the  image  structure.  The 
image  was  recovered  by  taking  another  Fourier  transform  of  the 
coded  image  to  recover  a decoded  irrege.  This  second  transform 
was  accomplished  using  diffraction  in  the  visible  region  in 
coherent  light  to  view  the  atomic  structure.  A similar  idea  in- 
volving a double  diffraction  system  will  be  used  in  Chapter  3 
to  carry  out  some  optical  computations.  Bragg's  imaging 

process  required  that  the  phase  of  the  recorded  transform  be 

8 9 

known.  In  1948  Gabor  ' introduced  a similar  coding  scheme 
that  recorded  phase  as  well  as  amplitude  of  a diffracted  field 
using  coherent  radiation.  In  this  process  the  amplitude  and 
phase  are  coded  in  the  form  of  an  intricate  diffraction  grating. 
This  grating,  called  a hologram,  is  made  from  the  interference 
pattern  between  the  original  object  wave  and  a reference  wave. 
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The  interference  pattern  is  recorded  on  a photographic 
emulsion.  The  object  is  decoded  by  viewing  the  diffracted 
wave  from  the  hologram. 

Other  methods  using  incoherent  light  for  coding  have 

been  used  in  crystallography  to  record  Patterson  projections  of 
10 

atomic  structure.  Such  projections  can  be  interpreted  as 
coded  versions  of  atomic  structure.  These  patterns  are  used  as 
models  and  are  created  using  convolutions  or  correlations  in 
visible  incoherent  light.  The  Patterson  projections  can  be 
compared  with  X-ray  diffraction  patterns  and  aid  in  estimating 
the  crystal  structure. 

1.3.2  Zone  Plate  Imaging  and  Aperture  Coded  Imaging 

The  recorded  diffraction  pattern  in  Gabor's  holo- 
graphy was  interpreted  in  terms  of  a generalized  zone  plate 

111*7  IQ  14 

by  Rogers . ' This  interpretation  led  Mertz  and  Young  ' 

to  the  earliest  aperture  coding  scheme,  zone  plate  imaging. 

In  zone  plate  imaging,  the  object  to  be  coded  was  placed  in 
front  of  a zone  plate  aperture  as  shown  in  Fig.  2.  Each  point 


on  the  object  creates  its  own  scaled  shadow  or  projection  of 
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the  zone  plate  aperture  at  the  recording  plane  on  photographic 

film.  This  is  shown  in  Fig.  2 for  a two-point  object.  For 

an  object  with  a continuous  intensity  distribution,  the  coded 

image  is  a convolution  of  the  object  with  a zone  plate.  Aperture 

coded  imaging  may  be  described  by  the  integral  in  Eq.  (1  - 6) 

if  the  object  being  coded  is  planar.  In  this  case,  the  impulse 

response  is  essentially  a space  invariant  zone  plate.  This 

plan  works  well,  provided  the  laws  of  geometric  optics  hold 

and  diffraction  (see  Chapter  2)  is  negligible.  When  this  is  not 

the  case,  then  the  "diffracted"  projection  of  a single  point 

must  be  used  for  the  impulse  response.  When  geometric  optics 

does  hold  the  coding  is  similar  to  holography.  The  diffraction 

from  the  coded  image  is  used  to  decode  the  coded  image  in  a 

manner  similar  to  a Gabor  hologram.  Recently  this  technique 

has  been  revived  for  gamma  ray  imaging.  ^ ' ^ 

18 

Dicke  has  proposed  a more  general  aperture  for 
coding  and  decoding.  In  his  scheme  a random  array  of  pinholes 
has  been  used  as  a coding  aperture.  To  decode  an  image  coded 
with  a pinhole  array,  a positive  transparency  of  the  coded 
image  is  optically  correlated  with  the  original  coding  mask. 
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The  correlation  peaks  in  this  process  produce  a decoded  image. 

This  correlation  scheme  has  been  tested  and  was  shown  feasible 

19 

for  Gamma  ray  and  X-ray  imaging  of  stars.  In  this  case 

20 

the  correlation  was  carried  out  using  holography.  Weiss 
has  recently  improved  the  correlative  technique  using  spa- 
tially incoherent  light  and  a non-redundant  array  of  points 

21 

suggested  by  Golay's  work.  In  addition,  optical  correlation 

22 

in  totally  incoherent  light  has  been  used  in  decoding. 

1.3.3  Deblurrinq  and  Image  Restoration 

23 

In  1953  Marechal  and  co-workers  had  experi- 
mented with  a double  diffraction  arrangement  to  carry  out 
optical  filtering.  Marechal's  approach  involved  placing  a com- 
pensating filter  in  the  frequency  domain  representation  of  a 
defective  photographic  transparency.  The  Fourier  transform 
of  the  defective  transparency  was  calculated  optically  using 
a lens  and  coherent  light.  (This  operation  will  be  described  in 
detail  in  the  next  chapter.)  The  compensating  filter  was  used 
to  reshape  the  Fourier  spectrum  to  a more  desirable  one.  A 

j 

J 


second  lens  was  used  to  calculate  the  corrected  or  decoded 
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image  from  the  corrected  transform  using  a second  diffraction 
process.  In  Chapter  3 a similar  computation  system  is  dis- 
cussed. Marechal  introduced  the  idea  of  "inverse"  filtering 
using  an  optical  computer.  (Inverse  filtering  will  be  discussed 
in  the  next  section.)  In  early  research  the  compensating  filters 
were  very  simple.  However,  in  general  such  filters  are  complex 
two-dimensional  functions.  These  filters  must  correct  phase 

24  25 

as  well  as  amplitude  and  are  not  easy  to  construct.  Tsujiuchi  ' 
constructed  improved  deblurring  filters  for  amplitude  and  phase 
correction.  The  process  he  used  in  making  his  filters  was  very 
difficult.  The  phase  part  of  his  filters  was  made  by  evaporating 
Mg?2  onto  a glass  plate  and  etching  out  the  proper  phase  cor- 
recting filter.  Such  filters  gave  good  results  especially  on 

26  27  28 

defocussed  blur.  Stroke  ' ' and  co-workers  have  consid- 

erably improved  inv  rse  filtering  by  making  the  compensating 
filters  holographically.  Holographic  filters  provide  phase 

correction  by  grating  diffraction.  Such  filters  can  be  made 

29 

using  only  photographic  processes.  Recently  Ragnarsson 
has  improved  the  holographic  decoding  filter  by  increasing  the 
dynamic  range.  This  filter  is  made  using  a bleached  hologram 


* 


14 


and  results  in  e filter  that  is  optimum  with  respect  to  additive 

30 

grain  noise.  Tichenor  has  recently  improved  Ragnarsson's 
filter  by  eliminating  the  effect  of  phase  errors  inherent  in  the 
bleached  hologram. 

Various  types  of  filtering  have  also  been  carried 

out  on  the  digital  computer  for  image  restoration.  Many  of  these 

techniques  are  analogous  to  the  optical  decoding  schemes 
31  32  33 

described  above.  * ' However,  there  are  more  challeng- 

ing schemes  that  can  be  carried  out  using  the  digital  computer. 
The  schemes  described  up  to  now  carry  out  decoding  using  "a 
priori"  information.  This  implies  a knowledge  of  the  process 
used  in  the  coding.  It  is  possible  in  certain  cases  to  estimate 
the  coding  process  from  the  coded  image  only.  This  type  of 

decoding  uses  "a  posteriori"  information.  An  example  of  such 

34 

a scheme  is  "blind  deconvolution".  Here,  it  is  assumed 
that  the  coded  picture  may  be  divided  into  contiguous  regions 
with  the  intensity  distributions  in  each  region  statistically 
independent.  It  is  assumed  that  each  region  has  the  same  coding 
transfer  function  associated  with  it.  Using  the  logarithm  of 
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! 

i 


the  coding  transfer  function  allows  the  product  in  Eq.  (1-7) 
to  be  expressed  additively.  Then  the  problem  of  estimating 
the  coding  transfer  function  is  reduced  to  using  any  one  of 
the  many  statistical  techniques  useful  for  additive  noise. 

There  are  many  additional  techniques  available  using 


the  digital  computer  for  decoding.  They  can  be  found  in  review 

1,35,36 


articles  on  image  restoration. 


1 . 4 INVERSE  FILTERING 

The  inverse  filtering  scheme  first  suggested  by 
Marechal  is  of  special  interest  in  relation  to  multichannel 
filtering.  Consider,  as  in  (1-7),  an  object  s in  the  frequency 
domain  coded  with  a transfer  H to  produce  the  coded  image  G: 

G = HS 

If  we  multiply  both  sides  of  the  equation  by  H *,  this  yields 

(1  - 9) 

In  principle,  S is  completely  recoverable  if  H is  known  and 
the  frequency  domain  multiplication  in  (1  - 9)  can  be  carried  out. 
This  can  be  done  on  a digital  computer  using  a sampled  version 


S = H *G  . 


,-l 


J 


of  the  coded  image  g and  the  fast  Fourier  transform  to  obtain 


16 


the  complex  frequency  domain  representation:  G.  The  sampled 
coded  image  can  be  obtained  by  optically  scanning  and  digitiz- 
ing the  intensity  information  from  a transparency  or  photograph 
of  the  coded  image.  Equation  (1  - 9)  is  then  executed  as  a 
set  of  complex  multiplications.  Also,  as  will  be  shown  later, 
a transparency  of  g can  be  used  directly  in  an  optical  computer 
to  yield  G.  This  process  is  used  in  the  inverse  filtering  schemes 
discussed  in  the  previous  historical  section. 

Although  the  ideas  above  are  very  appealing,  the 
inverse  filtering  scheme  unfortunately  cannot  be  realized 
directly  in  practice,  since  the  function  H * may  contain  poles 
and,  due  to  noise  limitations  in  the  original  coding  process, 

H * has  fixed  dynamic  range  and  cannot  take  on  infinite  values. 
In  practice,  only  approximations  to  H * are  used,  usually  a 
least  mean  square  estimator.  This  will  be  discussed  more  in 
Chapter  3. 

1 . 5 MULTICHANNEL  FILTERING 

In  Chapter  3 a new  scheme  is  suggested  that  can 
improve  considerably  the  inverse  filter  described  above. 
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Multichannel  filtering  is  an  "a  priori"  scheme  in  which  the  same 

object  is  coded  more  than  once  using  different  codes.  The 

different  coded  versions  of  the  image  are  chosen  to  maximize 

the  signal- to-noise  ratio.  A related  idea  has  been  used  in 

"multiframe  analysis"  for  "posteriori"  processing  of  coded 
37 

images . It  is  especially  suitable  for  images  degraded  by 
atmosphere  turbulance.  In  this  case  the  object  is  coded  with 
a set  of  different  codes  but  it  is  assumed  that  the  transfer 
functions  associated  with  the  codes  are  statistically  independent. 
This  is  the  reverse  of  the  "blind  deconvolution"  technique  which 
uses  a single  code  and  multiple  images.  The  "multiframe 
analysis"  can  be  considered  as  a special  case  of  the  very 
general  scheme  of  Chapter  3 , where  the  coding  transfer 
functions  are  Known  a priori  and  are  deliberately  chosen  to 
optimize  the  decoding  process. 

1.6  ADDITIONAL  COMMENTS 

In  the  large  majority  of  practical  problems,  the 
coded  image  is  usually  a degraded  image  unacceptable  for 
viewing  by  the  human  eye.  The  objective  of  the  decoding 
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process  is  to  create  a decoded  image  that  according  to  an  eye 
judgment  is  "better"  . It  should  be  made  clear  that  decoding 
does  not  change  the  information  content  of  the  coded  image; 
it  simply  shifts  the  coding  format.  In  fact  any  physical  de- 
coding process  must  introduce  noise  and  actually  lose  some 
information.  Decoding  is,  in  a sense,  a process  where  a 
certain  amount  of  information  is  lost  in  exchange  for  a more 
convenient  interpretation. 

1.7  THE  SCOPE  OF  THIS  REPORT 

In  Chapter  2 an  introduction  to  scalar  optics  is 
included.  This  brief  review  should  help  in  understanding  the 
optical  simulation  presented  later  in  Chapter  3.  Chapter  3 
includes  tne  theory  of  multichannel  image  decoding  with  an 
analysis  and  optical  simulation  designed  to  show  its  merit  in 
the  case  of  misfocus  blurring.  Conclusions  and  suggestions 
for  further  research  are  in  Chapter  4. 

This  report  presents  the  following  contributions 
to  image  decoding: 

(1)  A new  theory,  multichannel  image  decoding  that 


can  be  used  to  improve  the  signal- to- noise  ratio 
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in  inverse  filtering. 

(2)  A graphical  analysis  that- compares  one-  and 
two-channel  decoding  schemes  for  the  case  of 
mis  focus  blurring. 

(3)  An  optical  simulation  comparing  one-  and  two- 
channel  decoding  that  shows  considerable 
improvement  in  images  decoded  using  a two- 


channel  code. 


CHAPTFR  2 

SCALAR  DIFFRACTION  THEORY  AND  FOURIER  OPTICS 

In  Chapter  3 an  optical  simulation  will  be  carried 
out  using  a special  arrangement  of  lenses  to  carry  out  an  op- 
tical computation.  In  order  to  understand  the  workings  of 
this  arrangement,  some  knowledge  of  scalar  diffraction  theory 
and  Fourier  optics  is  necessary.  It  is  the  purpose  of  this 
chapter  to  provide  background  in  these  areas.  Scalar  dif- 
fraction will  be  described  using  the  concept  of  the  angular 
38  39  40 

spectrum.  ' ' This  approach  is  distinctly  different  from  the 

classical  method  employing  a Greens  function  solution  to  the 

41  42 

scalar  wave  equation.  ' This  presentation,  although  concise, 
will  be  adequate  to  cover  the  needs  of  Chapter  3.  For  more 

43  44 

information  on  diffraction  theory , additional  works  are  listed.  ' 
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2 . 1 THE  ASSUMPTIONS  OF  SCALAR  DIFFRACTION  THEORY 

The  term  diffraction  refers  to  any  perturbation  of  a 

43 

wavefront  thct  is  not  caused  by  reflection  or  refraction. 

Diffraction  phenomena  are  usually  associated  with  regions 

where  there  are  discontinuities  and  variations  in  the  field 

distribution  of  electromagnetic  radiation.  Diffraction  is 

commonly  observed  in  the  shadow  of  a sharp  edge  where  the 

edge's  shadow  appears  smeared  out  instead  of  the  sharp 

41 

light-dark  boundary  predicted  by  geometric  optics . A very 
detailed  accounting  of  diffraction  requires  a vectorial  approach. 
However,  it  is  fortunate  that  in  most  practical  situations  the 
polarization  of  the  electromagnetic  radiation  can  b‘j  ignored 
and  only  field  amplitudes  need  be  considered.  In  the  dis- 
cussion which  follows,  the  term  "field  amplitude"  can  be 
used  to  refer  to  either  the  electric  field  amplitude  or  the 
magnetic  field  amplitude.  It  will  be  assumed  that  only  a 
single  vector  component  of  either  of  these  fields  is  being 
modeled  and  that  the  individual  vector  components  are 
independent  of  each  other.  Actually  such  components  are 
coupled  together,  and  this  coupling  must  be  accounted  for 


i 
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using  Maxwell's  equations.  The  model  above  which  uses 
amplitude  only  is  the  basis  of  "scalar"  diffraction  theory. 
Such  a theory  has  been  shown  to  give  accurate  results  ex- 
perimentally under  certain  conditions:  (1)  the  size  of  the 
diffracting  structure  must  be  much  greater  than  a wavelength 
and  (2)  the  distance  from  the  diffracting  structure  at  which 

the  field  is  observed  is  also  much  greater  than  a wave- 
45 

length.  These  conditions  are  fulfilled  in  the  experiments 
which  follow.  The  smallest  diffracting  structure  will  be  due 
to  macroscopic  field  modulation  caused  by  variations  in  the 
spatial  distribution  of  the  average  grain  density  in  a photo- 
graphic emulsion.  Due  to  the  limited  bandwidth  of  the  emul- 
sion, the  smallest  size  of  this  structure  is  on  the  order  of 
-2 

5 x 10  mm.  as  compared  to  a wavelength  of  about 

-4 

6 x 10  mm.  The  diffracting  structure  size  is  limited  to  the 
highest  spatial  frequency  fn  a sinusoidal^  grid  that  can 

be  recorded.  Any  object  that  is  recorded  on  film  can  be 

t The  sinusoidal  grid  is  a grid  whose  field  ampli- 


tude varies  sinusoidally  in  one  direction  and  has  no  amplitude 
variation  in  a perpendicular  direction. 
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considered  as  a superposition  of  different  sinusoidal  grids 
if  the  recorded  two-dimensional  transmittance  is  decomposed 
mathematically  into  its  Fourier  components.  The  spatial 
frequency  response  of  a film  is  usually  expressed  in  terms  of 
a transfer  function  whose  maximum  value  is  normalized  to  1. 
The  absolute  magnitude  of  this  transfer  function  is  defined 
as  the  modulation  transfer  function  (MTF) . The  spatial  band- 
width of  the  film  will  be  defined  here  in  a manner  analogous 
to  that  used  in  electrical  engineering.  The  frequency  at 
which  the  MTF  drops  to  .7 07  is  the  upper  cutoff  frequency. 

The  MTF  for  most  commercial  films  is  available  in  research 
46  47 

literature.  ' The  fundamental  limitation  on  the  MTF 
frequency  response  is  the  grain  structure  of  the  film.  This 
must  be  considered  as  an  additional  microscopic  diffracting 
structure  which  produces  unwanted  noise.  This  will  be  dis- 
cussed further  in  Chapter  3. 

In  what  follows,  it  will  also  be  assumed  that  the 

41 

radiation  is  perfectly  monochromatic  and  spatially  coherent. 
This  situation  is  approximated  physically  when  a laser  source 


is  used. 
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2 . 2 DESCRIPTION  OF  A PLANE  WAVE 


For  a given  field  amplitude  component  u,  the  scalar 


wave  equation  must  be  satisfied: 


2 1 
V u = — : 


(2  - 1) 


Here , c is  the  speed  of  light  in  the  medium  through  which  the 

2 

wave  is  propagating,  t is  time,  and  V is  the  Laplacian  oper- 
ator in  rectangular  coordinates  defined  as 


2 

v = 


A particular  solution  of  (2  - 1)  is 


(2  - 2) 


u (r,t)  = A cos  (out  - k • r + <P  ) , (2-3) 

P o 


where 


/ 2 2 2 
r = vx  + y + z 


(2  - 4) 


and  is  the  magnitude  of  the  position  vector  r defined  as 


r = Xx  + Yy  + Zz  . 


(2  - 5) 


In  this  case  X,  Y,and  Z are  unit  vectors  along  the  x,y,  and  z 
axes  respectively.  Note  that  bars  will  be  used  to  indicate  a 
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vector  quantity.  The  quantity  k is  the  magnitude  of  the 


propagation  vector  k defined  as 
k= 


']• 


(2  - 6) 


X cos  a + Y cos  P + ZcosY 
The  cosines  of  the  angles  or,  P , and  V are  the  direction 
cosines  of  k and  are  determined  from  the  geometry  shown  in 
Fig.  3;  \ is  the  wavelength  of  the  propagating  wavefront  and 
<Pq  is  a phase  constant.  Equation  (2  - 3)  determines  a set 
of  plane  waves  propagating  in  the  direction  k.  This  is 
illustrated  in  Fig.  3.  For  a given  time  t,  a surface  of  constant 
phase  is  determined  if 


k • r = a constant.  (2  - 7) 

This  forces  the  argument  of  the  cosine  in  Eq.  (2  - 3)  to 
remain  constant.  Condition  (2  - 7)  determines  a plane  per- 
pendicular to  k.^® 

If  the  position  vector  r is  in  the  same  direction  as 

k then 


x = r cos  a, 
y = r cos  P , 

z = r cos  Y,  (2-8) 


Plane  Wavefronts  Propagate  in  the  Direction  of  Vector  k at 
Distance  \ Apart. 
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and  from  (2  - 5); 


2 2 2 2 
r • r = r =x  + y + z . 


(2  - 9) 


Substituting  the  relations  given  in  (2  - 8)  into  (2  - 9)  gives 

9 9 9 

cos  a + cos  P + cos  Y = 1 . (2-10) 

Therefore,  using  (2  - 6)  and  (2  - 10)  gives 

Also,  the  scalar  product  of  ic  and  r in  this  case  is 

r - 2TTr 
k • r = — : 

this  implies  that  the  argument  of  the  cosine  in  (2  - 3) 
changes  by  2 n for  a change  in  r of  \ . This  means  that 
the  distance  between  planes  of  equal  phase  is  \ as  shown  in 
Fig.  3.  As  t changes,  these  surfaces  move  in  the  direction 
of  k at  the  phase  velocity  c. 

The  direction  cosines  can  be  written  more  concisely 
if  the  following  definitions  are  used: 

L = cos  a. 


M = cos  8 , 
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Then,  for  the  position  vector  r in  any  direction: 

k • F = -.TT  ■ (Lx  + My  + Nz). 

K 

With  (2  - 10)  this  equation  can  be  rewritten 

k . F = ■■■-—-  (L  x + M y + J 1 - M^  - N z)  ; 

X 

therefore  (2  - 3)  becomes 

u (r,t)  = A cos  £<ut  - •“  (Lx  + My  +J 1-M  -N  z)  + CPQ  j • 

P (2  - 11) 

Equation  (2  - 11)  represents  a set  of  plane  waves  of  frequency 

a)  propagating  in  a direction  determined  by  two  directions 

cosines:  M and  N. 


2.3  PHASOR  REPRESENTATION 

The  general  solution  for  Eq . (2  - 1)  for  monochro- 
matic radiation  is: 

u (F,t)  = A (F)  cos  [tut  + tp  (F)],  (2  - 12) 

where  A (F)  is  the  amplitude  as  a function  of  position  and 
9(r)  is  the  phase  as  a function  of  position.  Equation, (2  - 12) 
can  be  rewritten 

u (r  ,t)  = RE  [(v  (r)  exp(- J tut)]  , (2-13) 

and  v (r)  is  called  a ’’phasor"  and  is  defined  as  follows: 


v (F)  = exp  [-  j <P  (r)]  . 


(2  - 14) 
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Re  refers  to  the  real  part  of  the  quantity  in  the  square  brackets 
of  (2  - 13).  Actually  (2  - 14)  by  itself  is  an  adequate  descrip- 
tion of  the  scalar  field  u (r  ,t) . The  time  dependent  part, 
exp  (j  out) , is  the  same  for  any  value  of  r and  can  always  be 
conveniently  added  if  an  explicit  representation  is  desired. 

The  phasor  (2  - 14)  keeps  track  of  the  relative  phase  of  the 
scalar  field  at  any  location.  In  the  rest  of  this  report 
it  will  be  assumed,  unless  otherwise  stated,  that  the  phasor 
representation  is  used  to  describe  any  field  amplitude. 

The  equation  for  a set  of  plane  waves,  Eq.  (2  - 11), 
can  be  conveniently  rewritten  in  phasor  form.  Let  be  the 
associated  phasor;  then 

v =Aexp|"j-^- — (Lx+  My +*il-M2-N2  z)l. 

P L J (2-15) 

This  representation  of  a plane  wave  will  be  very  meaningful 

when  the  concept  of  the  angular  spectrum  is  considered. 

2.4  THE  ANGULAR  SPECTRUM 

When  the  definition  of  a two-dimensional  Fourier 


■ 


I 


l 


transform  given  in  Chapter  1 is  used,  the  Fourier  transform  of 
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Integral  of  (2  - 19)  defines  a sum  over  a continuum  of  plane 
waves  that  are  superposed  at  z = 0 to  form  t (Xj  ,yj) . The 
amplitude  T (? , T))  represents  the  amplitude  density 
in  plane  wave  domain  description  of  t (x ^ y ^ ) and  is  called 
the  "angular  spectrum"  at  z = 0. 

2.5  THE  PROPAGATED  ANGULAR  SPECTRUM 

The  angular  spectrum  at  a distance  z from  the 
z = 0 plane  can  now  be  determined  from  the  phase  shift  of 
an  arbitrary  plane  wave.  Consider  a planewave  that  travels 
in  the  direction  of  the  propagation  vector  k.  If  the  wave 
moves  a distance  d along  the  propagation  vector,  then  the 
phase  shift  of  the  displaced  wavefront  is 

exp  ( j k d ) 

which  can  be  expressed  in  terms  of  z.  From  the  geometry, 

d = z cos  Y , 

but  using  (2  - 10)  gives 

I 2 2 / 2 2 

d = zvl  - cos  a - cos  6 = zvl  - L - M . 
Therefore,  the  additional  phase  shift  of  the  propagated 

exp  ) k zJi~- , 


spectrum  is 


119 
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and  the  propagated  angular  spectrum  is 

T2(^-f -2) = Ti  (l  ■ exp  (' k 2 ^ - l2  - M*|  j 20) 


The  propagated  spectrum  can  be  used  to  determine 
the  field  amplitude  at  a distance  z from  the  z = 0 

plane;  this  gives 


or  substituting  from  (2  - 20) 


WV = 


ffTl(^t}\)exp[ik  (X2L  + 72M  + z^-  L2  - M2)]d(x)d(x)  * 

(2-21) 


Therefore,  the  propagated  angular  spectrum  from  a field 
amplitude  distribution  (x^y^  can  be  used  to  calculate  the 
diffracted  field  at  a parallel  plane  a distance  z away, 

,2<x2'y2)- 

2.6  THE  FRESNEL  APPROXIMATION 

The  Fresnel  approximation  to  the  Huygens-Fresnel 
Diffraction  formula  can  be  derived  directly  from  (2  - 21). 


3. 


The  following  approximation  can  be  made  by  using  the 
binomial  theorem: 

Jl-L2-M2  ^ 


(2  - 22) 


L « 1 . 

M « 1 . 

Substituting  this  approximation  into  (2  - 21)  gives 


t2  <x2  ,v2)  = exp  (1  k ^)exp  [-)  k z (L-pLJj 

exp[)2n(x2i+y2  d(-f)d(f)  . 

Therefore,  using  the  notation  for  the  Fourier  transform  given 
in  Chapter  1; 


= e,kZF‘ 


‘Kf.f) 


exp  -j  k z 


^>]|  • 


Substituting  from  (2  - 18)  gives 

l2  ^X2'y2^  = exp  Fl_1|  exp[-jn\z  (?2  + 7)2)]  | . 

(2  - 23) 

Therefore,  the  field  amplitude  t2^x2'y2^  is  founc*  by  taking  the 
Fourier  transform  of  the  weighted  transform  of  ^(x^  ,yj) . This 
is  more  conveniently  stated  in  the  space  domain  using  the 


i 
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[ 


i 


ft 


convolution  theorem  discussed  in  Chapter  1.  Since 


F_1  jexp  ^ j tt  X z (i2  + Tl2)j|=  exp 


Jk 


, 2 ^ 2\ 
(x2  + y2  ) 


and 


F_1  ^ T(?  ,T1)J  = t1  (x1,y1)  ; 
the  convolution  theorem  gives 


*2  (x2,y2)  = 


*1  <Vyl>  [(x2‘xl)2  ' (y2-yl)2]|dxldyl- 


(2  - 24) 


Equation  (2  - 24)  is  known  as  the  Fresnel  approx- 
imation. It  represents  a very  useful  approximation  to  the 
Huygens-Fresnel  diffraction  integral  in  terms  of  a linear 
spatially  invariant  mapping.  Certain  assumptions  are 
tacitly  implied  in  its  use.  The  approximation  given  in  (2  - 23) 
implies  that  cos  Y be  very  small,  or  that  the  angle  of  diffrac- 
tion is  small.  The  quadratic  term  in  the  exponential  Qf  the 

integral  represents  a quadratic  approximation  to  a spherical 
42 

wave.  This  is  valid  if 

z >> J(x2  - xx)2  + (y2  - yt)2  . (2  - 25) 


J 


Also,  it  should  be  pointed  out  that  the  integral  from  - ® to 
+ ® in  Eq.  (2  - 23)  requires  | and  | —■  | to  exceed  1 , 
which  implies  that  the  value  of  the  direction  cosines 
exceeds  1.  This  is  possible  for  complex  arguments  and 
physically  represents  evanescent  waves.  These  waves 
propagate  in  the  x and  y directions,  but  die  off  exponen- 
tially in  the  z direction.  Since  they  die  off  so  rapidly,  their 

42 

effect  can  be  neglected. 

2.7  THE  PHASE  SHIFT  MODEL  OF  A THIN  LENS 


The  classical  "thin"  spherical  lens  can  be  effec- 

42 

tively  modeled  using  a quadratic  phase  shift.  If  the  lens 
is  assumed  infinite  in  size  with  a focal  length  f,  then  it 
can  be  described  by  the  following  complex  transmittance: 


exp 


. k , 2 ^ 2, 
1 2f  (x  + y> 


(2  - 26) 


It  is  assumed  that  the  lens  is  infinitesimally  thin  and  fills 
the  x - y plane.  A real  lens  with  a finite  thickness  is  fairly 
well  modeled  using  (2  - 26) . The  effect  of  most  thick  lenses 
is  to  translate  the  diffracted  field  slightly  along  the  optical 


axis  by  the  distance  between  its  principal  planes.  Usually 
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this  distance  is  small  enough  to  be  neglected.  Where  a 
multielement  lens  is  used,  the  focal  length  of  the  effec- 
tive thin  lens  is  measured  from  the  principal  planes  of  the 
multielement  system.  This  is  usually  a minor  problem  in 
using  a lens  for  an  optical  computer,  since  it  primarily 
effects  certain  scaling  factors  that  are  easy  to  measure 
directly  and  can  be  accounted  for  without  a more  exact  model 
of  the  lens  using  its  principal  planes. 

The  ideal  lens  described  above  can  be  used  to  per- 
form very  complex  optical  computations  using  the  field  am- 
plitudes. The  most  important  of  these  is  the  two-dimensional 
Fourier  transform. 


2.8  OPTICAL  COMPUTATION  OF  THE  FOURIER  TRANSFORM 
The  lens  arrangement  shown  in  Fig.  4 can  be 
used  to  calculate  the  two-dimensional  Fourier  transform  of 


an  arbitrary  field  amplitude  distribution  b (x^  .y^) . The 


Fourier  transform  B 


/iV) 

\Xf  ' X f / 


occurs  in  the  back  focal  plane 


of  lens  Lj . This  can  be  shown  by  straightforward  appli- 


cation of  the  Fresnel  approximation  to  the  optical  system. 


i Arrangement  Used  to  Compute  the  Fourier  Transform  of  b(xj  ,Yi) 
Fourier  Transform  Occurs  In  the  x3-y3  Plane. 
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The  diffracted  field  from  b (x^y^  at  the  front  side  of  lens 


L is  p (x  ,yj  . This  is  calculated  directly  from  Eq.  (2  - 24) . 

X C*  L* 


This  gives 


P(*2,y2)  = 


saL^#<VyI> 


Uf 


exp 


2 f 


<Vxi)2+(Vyi)2 


dXjdyj  . 


The  field  at  the  back  side  of  lens  1^  is  p' (x2,y2)  where 


p'  (x2,y2)  = p(x2,y2)  exp 


k . 2 2. 

TT  (x2  ^ 1 


The  field  a distance  f in  back  of  1^  is  then  q(x3>y3),  where 


q(x3,y3)  = 


“f &*//*' *i- 


y2)  exp 


JJS_ 

2 f 


<VX1>  + (y2‘yl>' 


dx2dy2  • 


If  q is  expressed  in  terms  of  b directly,  this  yields 

+ 00 


<,(Vy3)  ’ ' eJ^mffffhUl‘Vl)  eXP 


X f 


liS_(x  2+y  2) 

2 f ^X1  yl  ’ 


exp 


1 k ,2  2, 1 J_k_  , 2 . 2. 

IT  X2  +y2  ) 6XP  2?  (X3  +y3  > 


exp  - ^ x2  (x3  + xx)  + y2  (y3  + yj 


dxldyl  dx2dy2' 


(2  - 27) 


I 


1 


This  integral  is  the  Fourier  transform  of  b (Xj  ,yj) . The 


3 y 3 

frequency  domain  variables  in  this  case  are  and  — . 


Therefore,  except  for  a multiplicative  constant  an  exact 


Fourier  transform  of  b^  (Xg/Yg)  occurs  in  the  back  focal 


plane  of  Lj . The  lens  Lj  can  be  thought  of  as  an  optical 
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computer.  With  two  lenses  it  is  possible  to  carry  out 
filtering  operations  in  the  back  focal  plane  of  a lens  and 
recover  the  filtered  image  with  an  additional  lens.  This  will 
be  explained  in  the  next  chapter. 


CHAPTER  3 

MULTICHANNEL  IMAGE  DECODING 

In  Chapter  1,  a decoding  scheme  using  an  inverse 
filter  was  discussed.  It  was  pointed  out  that  in  practice  it  is 
not  possible  to  recover  information  in  the  frequency  plane 
where  the  coding  transfer  function  has  zeros  or  approaches 
zero,  due  to  limitations  set  by  noise.  In  this  chapter  a very 
general  scheme  is  introduced  that  can  improve  the  signal-to- 
noise  ratio  and  increase  the  amount  of  information  recovered 
in  a decoding  operation.  It  will  be  shown  that  coding  an 
image  with  more  than  one  code  can  be  advantageous.  Each 
version  of  the  coded  image  is  a separate  information  "channel" 

S’ 

. 

which  can  be  used  to  recover  the  decoded  image.  An  applica- 
tion of  this  multiple-coding  scheme  will  be  examined  in  detail 
for  the  case  of  severe  misfocus  blurring. 
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3 . 1 FINITE  RANGE  INVERSE  FILTERS 

Since  the  dynamic  range  of  inverse  filters  is  noise- 
limited,  inverse  filters  with  a finite  dynamic  range  will  be  con- 
sidered. In  regions  where  the  signal-to-noise  ratio  prevents 
recovery  of  a particular  point  in  the  frequency  plane,  the  value 

of  the  inverse  decoding  filter  becomes  arbitrary.  For  example, 

24 

the  filter  has  simply  been  set  to  the  maximum  value.  However, 

when  noise  is  studied  in  more  detail,  it  is  better  handled  using 

a linear  optimal  estimator.  A linear  .aast-mean-square  error 
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inverse  filter  T for  the  coding  transfer  function  H is 


T = H 


+ lHT 


(3  - 1) 


Here  a is  the  signal-to-noise  ratio  defined  in  the  frequency 

domain  as  the  ratio  of  the  Wiener  spectrum  of  the  coded  image 

to  the  Wiener  spectrum  of  the  noise.  In  common  practice  the 

recording  is  usually  made  on  photographic  film  and  the  noise 

is  primarily  grain  noise,  a is  usually  approximated  by  a con- 

2 4 

stant.  For  fine  grain  emulsions,  a ranges  from  10  to  \0  . 


The  filter  T minimizes  the  mean  square  error  in  the  intensity 
difference  between  the  original  image  before  coding  and  the 
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and 

i ’ 

! 

S ' = Hr  S . (3-4) 

Note  that  HH„  * must  be  1 or  0;  theretore  H is  a binary 

r K 

function  such  that 

Hr  = 1 |H|  i D 

H = 0 elsewhere  . (3-5) 

R 

3.2  MULTICHANNEL  IMAGE  DECODING  WITH  A 
COMPOSITE  FILTER 

Consider  an  object  coded  using  n different  codes  to 
create  n separate  coded  images  or  channels.  For  the  ith  chan- 
nel, the  output  g.  is  the  convolution  of  the  image  with  an  im- 
pulse response  h^  Therefore, 

g.  = h.  * s.  (3-6) 

The  impulse  response  for  each  channel  is  different.  In  the  fre- 
quency domain,  the  output  for  the  ith  channel  is 

G = H.  S.  (3  - 7) 

The  upper-case  variables  in  the  frequency  domain  correspond 
to  lower-case  variables  in  the  space  domain.  A particular 
point  S^.'Tl)  in  the  frequency  domain  be  recovered  using 
the  inverse  filter  for  any  channel.  iplying  through  (3  - 7) 


45 


by  the  inverse  for  the  ith  channel  gives 

G^.n)  = H^1  (5, 11)1^(5,11)  S(g,n) 
or 

S(5,n)  = H^- 1 (5 , lD  G^s.n)  (3  - 8) 

In  general  any  channel  can  be  used  to  attempt  a recovery  of 
S(5  , T))  - There  is  complete  freedom  to  choose  the  channel  that 
maximizes  the  signal- to- noise  ratio.  The  total  effect  of  selec- 
tively choosing  between  different  channels  for  recovering  fre- 
quency domain  information  is  a "composite"  coding  transfer 
function  and  a composite  decoding  inverse  filter.  The  image 
can  be  thought  of  as  coded  with  a single  transfer  function  that 
is  made  up  from  a mosaic  using  pieces  of  the  original  n coding 
transfer  functions.  Associated  with  this  composite  coding 
function  is  a composite  decoding  filter.  For  a normalized 
composite  coding  transfer  function  Hp,  the  inverse  filter  or 

decoding  filter  is  H_  *.  The  information  recovered  using  H 
o ' C 

can  be  maximized  by  carefully  choosing  the  combination  of 
codes  used.  This  will  be  demonstrated  later  using  a two- 
channel  code. 


In  practice,  an  image  coded  with  a transfer  function 
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H must  be  decoded  with  a finite  range  inverse  filter 

C Ur 

If  the  approximation  to  the  mean  square  error  filter  described 
in  (3  - 2)  is  used,  then  1 is  defined  as 

H__1  = H _1  if  1 2 |H  1 s D 


CF 

* 0 


C 

elsewhere. 


(3  - 9) 


The  resulting  restored  transfer  function  HCR  is,  using  (3  - 5), 


hcr  1 


HCR  ° 


if  |HC|  * D 
elsewhere. 


(3  - 10) 


If  the  composite  transfer  function  is  to  maximize  the  signal-to- 
noise  ratio,  then 


-1 


-1 


|HC|  s D iff.  |H.  \ s D for  at  least  one  i 


Therefore 


hcr  - 1 


hcr  = 0 


-1 


iff.  |H.  | 2 D for  at  least  one  i. 
elsewhere.  (3  - 11) 


For  a given  point,  S(|  ,1))  can  be  recovered  and  H^R  = 1 if  any 
one  of  the  coding  channels  has  a coding  function  | H^(§  , T))  J * 
D-1.  Using  (3  - 5),  if  the  decoded  image  is  S',  gives 


s'  - hcrs  • 


(3  - 12) 
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Equation  (3  - 12)  will  be  useful  In  the  optical  simulation  to  be 
described. 

3.3  SEVERE  MISFOCUS  BLURRING 

As  an  example  of  a multichannel  decoding  application, 
misfocus  blurring  will  be  used.  When  an  aberration  free  lens, 
stopped  with  a round  aperture,  is  used  to  form  a severely  mis- 
focused  image,  the  normalized  transfer  function  associated 
with  the  blur-coded  image  is  approximately 

2 J.  (np) 

ha(*>  - ’ <3  - 13) 

2 2 

where  p = 5 + T]  is  the  frequency  domain  variable;  is 

circular  symmetric.  The  equation  (3  - 13)  is  accurate  for  ex- 
treme misfocus  where  diffraction  effects  can  be  ignored.  In 
the  space  domain,  this  represents  a convolution  of  the  original 
object  with  a circular  disk.  This  also  corresponds  to  coded 
aperture  imaging  where  the  coding  aperture  is  circular.  A plot 
of  this  function  is  shown  in  Fig.  5 for  a dynamic  range  of  100. 
The  phase  and  log  of  the  magnitude  are  plotted  separately. 

Figure  6 shows  the  finite  range  Inverse  filter  used  to  decode 
an  image  coded  using  (3  - 13). 
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3.4  A TWO- CHANNEL  DECODING  SCHEME 

A multichannel  coding  scheme  can  be  formulated 
using  the  blur  code  just  discussed.  Let  an  image  be  coded 
using  the  following  two  codes: 

2 J,  (tt  p) 

ha<p>  - <3  - 141 

2 J.  (tt  A p) 

H_(p)  = (3  - 15) 

B TT  A p 

where  A is  a constant  such  that  A 2 1.  Physically,  this  corre- 
sponds to  blurring  the  image  twice  with  different  amounts  of 
blurring.  If  the  image  is  decoded  with  a two-channel  finite 
range  inverse  filter  with  a dynamic  range  D,  then  using  (3  - 11) 
the  restored  transfer  function  HR2  is 

Hr2  = 1 where  \EA\  2 D_1  or  ) HR  | s D~ 1 

H = 0 elsewhere.  (3  - 16) 

For  comparison,  the  one-channel  code  using  (3  - 14)  has  a re- 
stored transfer  function  HR1>  where 

H = 1 where  \ HA  \ > D_1  ; 

HR1  = 0 elsewhere.  (3  - 17) 


: 
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Hr1  has  only  one  condition  for  recovery  of  information,  while 
Hr2  has  two.  By  carefully  choosing  A,  it  is  possible  to  opti- 
mize, in  some  sense,  the  information  recovered. 

3.5  A GRAPHICAL  ANALYSIS 

The  constant  A is  a scaling  factor  that  is  used  to 
"contract"  the  transfer  function  H . If  A is  properly  chosen, 

O 

the  transfer  function  HR  will  overlap  in  the  zero  regions  of 
in  the  composite  transfer  function.  This  can  be  used  to  elimin- 
ate zero  regions  in  the  restored  transfer  function.  Ideally,  A 
should  be  adjusted  for  the  particular  image  being  coded.  Dif- 
ferent values  of  A should  be  tried  until  the  "best"  image  is 
decoded  in  some  sense,  such  as  determined  by  a mean  square 
error  criterion  or  judgment  by  eye.  However,  adjusting  A for 
each  image  would  be  a difficult  task.  Instead,  it  might  be 
more  useful  to  find  a criterion  for  a nonspecific  image.  A par- 
ticularly easy  criterion  to  carry  out  analytically  is  to  .maximize 
the  frequency  range  up  to  the  first  zero  in  the  restored  transfer 
function.  The  justification  for  this  criterion  will  be  given  later 
using  an  optical  simulation,  where  the  eye  can  judge  and  com- 
pare two-channel  versus  one-channel  coding  and  decoding. 
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To  optimize  A,  a digital  computer  can  be  used.  For  a given 
dynamic  range  D,  the  restored  transfer  functions  are  deter- 
mined from  (3  - 16)  for  different  values  of  A.  The  A which 
maximizes  the  frequency  range  to  the  first  zero  determines 
the  optimal  code.  This  was  tried  but  was  found  to  require  an 
excessive  amount  of  computer  time.  A better  plan  involving 
a graphical  approach  was  used. 

If  the  two  coding  transfer  functions  were  plotted 
together  on  the  same  graph,  the  frequency  range  from  p=0  to 

the  first  zero  in  H „ can  be  read  directly.  For  a given  dynamic 
HZ 

range,  it  is  necessary  only  to  observe  the  frequency  range  up 
to  which  the  absolute  magnitude  of  at  least  one  of  the  transfer 
functions  stays  above  the  dynamic  range.  This  procedure 
would  require  a different  set  of  graphs  for  each  A.  This  can 
be  avoided  by  plotting  the  transfer  functions  versus  log  p in- 
stead of  p . Since 

log  (A  p)  = log  A + log  p , (3-18) 

a change  in  A or  the  scaling  of  H requires  only  a shift  in 

D 

position.  It  is  necessary  only  to  plot  two  identical  transfer 
functions  (in  this  case  2 (tt  p)/n  p ) and  move  one  transfer 
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: 


function  relative  to  the  other  along  the  log  p axis  a distance 
log  A . To  facilitate  the  shifting  of  the  transfer  functions,  two 
identical  plots  of  were  made  on  separate  pieces  of  trace 
paper.  The  plotted  graphs  were  then  superposed  on  a light 
table  and  could  be  moved  relative  to  one  another.  The  plots 
were  made  using  a digital  computer  and  a Calcomp  plotter. 

The  log  of  the  transfer  function  modulus  was  plotted  instead 
of  the  modulus  to  ease  reading  small  values  and  allow  dynamic 
ranges  from  0 up  to  100  to  be  r^ad  from  one  graph.  The  Cal- 
comp plot  is  shown  in  Fig.  7.  The  graph  is  on  a 10"  by  20" 
rectangular  grid  and  is  accurate  to  .02".  By  trial  and  error, 
it  was  easy  to  shift  the  relative  positions  of  the  graphs  to 
maximize  the  frequency  range  to  the  first  zero  in  the  composite 
restoring  function  HR2* 

The  results  of  this  analysis  are  shown  in  Fig.  8. 

The  solid  line  shows  the  maximized  frequency  range  up  to  the 
first  zero  of  HR2#  This  can  be  compared  with  range  to  the  first 
zero  of  HR^  , shown  by  the  dotted  line.  Above  D =-  8,  the  two- 
channel  scheme  becomes  advantageous.  HR^  has  information 
"gaps"  located  near  the  zeros  of  H^.  Therefore  information  is 


missing  in  regions  near  p =-  1.2,  2.2,  3.2,  etc.;  these  are  the 


for  One- Channel  and  Two- Channel  Decoding  Versus  Log  D. 


roots  of  H^.  When  the  first  zero  of  lies  beyond  one  of 
these  regions,  the  two-channel  filter  can  fill  in  or  "bridge" 
the  information  gap.  The  location  of  the  first  zero  can  shift 
abruptly.  These  shifts  are  located  at  points  where  a gap  has 
just  been  bridged  in  one  channel  by  the  other.  The  slope  dis- 
continuities are  due  to  the  different  rates  at  which  the  zero 
shifts  with  dynamic  range  in  the  two  different  channels.  The 

7 

distance  to  the  first  zero  for  varies  approximately  as  D ' . 

3.6  BINARY  DENSITY  PLOTS  OF  THE 
RESTORED  TRANSFER  FUNCTIONS 

It  is  interesting  to  make  binary  density  plots  of  H 

K1  / 

I 

and  ln  the  frequency  plane  for  a specific  dynamic  range. 

A range  with  D=100  represents  about  the  best  "state  of  the 

art"  inverse  filter  used  in  optical  filtering.  This  compares 

well  with  the  range  of  digital  computers  which  are  limited  by 

input  scanners.  Typical  scanners  have  a dynamic  range  of 
52 

about  128. 

Figure  9 shows  the  binary  density  plots  of  HR1  and 
HR2  for  D=100.  The  regions  in  the  frequency  domain  where 


the  restored  transfer  functions  equal  one  are  shown  in  white. 
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The  black  indicates  areas  where  the  restored  transfer  functions 
are  zero.  In  Fig.  9(a),  the  black  annuluses  indicate  informa- 
tion gaps  near  the  zeros  of  H^.  In  Fig.  9(b),  shows  re- 
covery of  information  near  the  first  six  zeros  of  . Two- 
channel  decoding  yields  about  37%  more  recovered  area  in  the 
frequency  domain.  The  maximum  spatial  frequency  at  which 
information  is  retrieved  in  Fig.  2(b)  occurs  at  p =-  8.9. 

3 . 7 VALIDITY  OF  THE  CRITERION  USED 

The  criterion  discussed  for  maximizing  a has  shown 

to  be  of  great  value  in  eliminating  frequency  domain  information 

gaps  nears  zeros.  It  should  be  pointed  out  that  the  accuracy 

of  the  finite  range  inverse  filter  used  to  model  decoding  assumes 

30 

that  the  coded  images  have  a low  noise  content.  This  as- 
sumes that  D * is  much  greater  than  the  signal- to- noise  ratio. 
This  is  the  case  in  the  examples  discussed  in  Section  3. 6 
where  the  dynamic  range  can  be  one  or  two  orders  of  magnitude 
above  film  grain  noise.  This  assumption  is  necessary  in  the 
optical  simulation  to  be  discussed  where  noise  is  neglected. 

In  this  case,  an  optical  simulation  using  only  the  restored 
transfer  functions  gives  a valid  comparison  between  one-  and 


two- channel  decoding. 

3.8  AN  OPTICAL  SIMULATION  OF  TWO-CHANNEL 
AND  ONE- CHANNEL  DECODING 

The  restored  transfer  functions  for  the  case  of  one- 
channel  and  two- channel  coding  can  be  used  to  compare  the 
two  decoding  schemes.  Since  the  decoded  image  is  related  to 
the  coded  image  directly  using  the  restored  transfer  function, 
(see  Eq.  (3  - 12))  a comparison  was  made  between  the  two  dif- 
ferent codings  using  only  the  restored  transfer  functions. 
Equation  (3  - 12)  was  implemented  using  an  optical  computing 
arrangement. 

In  Chapter  2 it  was  shown  that  a lens  can  be  used 
to  compute  the  Fourier  transform  of  a given  E-field  distribution. 
If  a transparency  with  an  E-field  transmittance  proportional  to 
some  arbitrary  test  image  s(x,y)  is  placed  in  a collimated  laser 
beam,  then  an  E-field  distribution  proportional  to  the  image 
distribution  is  obtained.  This  situation  is  shown  in  Fig.  10. 

A lens  L^  with  a focal  length  f^  is  used  to  get  a scaled  Fourier 
transform  in  the  back  focal  plane  of  the  lens.  (See  Eq.  (2  - 12). 
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The  effect  of  a coding-decoding  operation  requires  multiplica- 
tion of  the  Fourier  transform  by  the  restored  transfer  function 
Hd  to  get  the  decoded  image  transform  S ' (x,  y) . This  is  accom- 
plished  by  placing  a transparency  proportional  to  H , that  is 
KH„,  in  the  frequency  plane;  K is  a constant.  The  product, 


occurs  in  the  frequency  plane.  Lens  performs  another 
scaled  Fourier  transform  to  recover  the  decoded  image.  The 
image  is  inverted,  since  two  forward  transforms  have  occurred; 
this  gives 

-flx3  -fly3\ 

£2  ' f2  ) ' 


-P-  S‘( 

X flf2  \ 


Using  the  lens  system  described  above  with  the 
restored  transfer  functions  for  one-  and  two-channel  decoding, 
a simulation  was  carried  out  to  compare  the  two  different  codings 


on  several  images. 
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3.9  THE  EXPERIMENTAL  SETUP 

The  optical  bench  setup  used  in  carrying  out  the 
simulation  is  shown  in  Fig.  11.  The  lens  system  of  Fig.  10 
is  used.  The  lens  is  75  mm  in  diameter  with  = 300  mm. 
L2  is  50  mm  in  diameter  with  a focal  length  of  330  mm.  Using 
geometrical  optics,  the  largest  ray  angle  of  a point  on  axis 
in  the  input  plane  that  reaches  the  output  plane  is  =*■  4, 8°  . 
This  gives  a frequency  cutoff  near  130  lines/mm  for  a wave- 
length of  62 38 A.  The  transparencies  used  were  rectangular 
with  an  aspect  ratio  that  varied  for  different  subjects.  The 
cutoff  frequency  for  the  recorded  image  on  the  transparencies 
was  about  30  lines/mm,  well  below  the  optical  system  band- 
width. Since  the  transparencies  were  small,  the  off-axis 
points  had  approximately  the  same  bandwidth;  thus  the  effects 
of  the  lens  stops  were  negligible. 

A television  vidicon  was  placed  in  the  output  plane 
of  the  optical  system.  The  decoded  image  was  observed  on  a 
9-inch  diagonal  monitor.  A Polaroid  camera  with  a closeup 
kit  was  used  to  record  from  the  monitor.  Using  the  television 


camera  had  several  advantages:  it  gave  a large  bright  image 
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that  was  easy  to  view  and  photograph,  it  allowed  the  contrast 
to  be  adjusted  for  best  viewing,  and  it  eliminated  speckling 
effects.  The  speckling  was  eliminated  due  to  its  low  pass 
frequency  characteristics.  In  terms  of  the  size  of  the  images 
viewed,  the  cutoff  was  about  35  lines/mm. 

The  restored  transfer  functions  were  photographed 
from  the  drawings  shown  in  Fig.  9.  The  filters  were  reduced 
to  a diameter  of  1.5  mm.  (The  diameter  is  measured  out  to 
the  highest  frequency  passed.)  This  required  a reduction  of 
about  92X  from  the  original  drawings.  This  was  accomplished 
by  photographing  in  two  stages.  The  filters  were  first  reduced 
10X  by  photographing  them  on  Kodak  high  contrast  copy  film. 

A contact  print  positive  was  then  made  on  Kodalith  film.  This 
positive  was  then  used  to  make  a negative  print  on  Kodak 
polycontrast  F resin-coated  paper.  A second  reduction  of 
about  9X  was  made  by  photographing  the  negative  print  with  a 
35  mm  camera  on  Kodak  high  contrast  copy  film.  This  produced 
a reduced  positive  of  the  original  transfer  functions.  Since 
the  restored  transfer  functions  were  binary  functions,  the  E 
field  transmittance  was  the  same  as  the  intensity  transmittance. 
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It  was  only  necessary  to  get  as  much  contrast  as  possible  in 
the  recorded  images.  The  high  contrast  film  used  had  a y =-  5. 
Under  a microscope,  the  recorded  filters  showed  good  contrast 
and  only  a small  amount  of  edge  spreading. 

The  subjects  used  in  testing  were  reductions  made 
from  mounted  photographs.  The  transparency  negatives  were 
made  on  Kodak  panatomic  film  and  developed  to  a y=  .6.  The 
negatives  were  then  contact  printed  on  Kodak  fine  grain  positive 
release  film,  which  was  developed  to  a y^l  .6.  This  gave  a 
low  contrast  positive  with  a ya,l.  The  test  subjects  were  in 
a rectangular  format  against  a dark  background.  It  can  be 
shown  that  a low  contrast  intensity  recording  produces  an  E- 
field  transmittance  proportional  to  the  intensity  of  the  record- 
ing. This  was  originally  discussed  by  Tsuchichu  and  his 
results  are  given  in  Appendix  I. 

The  test  transparencies  and  the  restored  transfer 
functions  were  mounted  in  liquid  gates  to  reduce  phase  dis- 
tortions caused  by  thickness  variations  in  the  photographic 
emulsion.  The  liquid  gate  consists  of  two  optically  flat 
pieces  of  glass  between  which  the  photographic  transparency 


is  placed  in  an  index-matching  fluid.  The  index- matching 
fluid  is  chosen  to  match  the  index  of  refraction  of  the  photo- 
graphic gelatin,  about  1.51.  The  gate  for  the  restored  transfer 
function  was  mounted  on  an  x-y  translator.  This  allowed 
accurate  positioning  of  the  filters  in  the  Fourier  transforms 
plane . 

A spoke  pattern  was  used  to  position  the  filters 
accurately.  When  the  restored  transfer  functions  were  properly 
aligned,  the  spoke  showed  a circularly  symmetric  pattern  of 
straight  spokes  with  notches  at  the  missing  frequencies.  When 
the  filters  were  misaligned  or  phase  distortions  were  present, 
the  spoke  pattern  was  not  symmetric  and  showed  "kinks"  in 
the  spokes.  Once  the  spoke  pattern  was  aligned,  it  was  re- 
placed with  a test  transparency,  and  the  simulated  decoded 
image  was  photographed. 

3.10  TEST  RESULTS 

Results  of  the  optically  computed  simulation  are 
given  in  Figs.  12  through  17.  The  subjects  are  designated  by 
numbers  1,  2,  3.  Each  subject  has  four  pictures  associated 


Vidicon  Monitor;  (b)  Blur  Coded  Image 


; (b)  Simulated  Decoded  Image  Using  Two- 
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Vidicon  Monitor;  (b)  Blur  Coded  Image . 


Channel  Decoding;  (b)  Simulated  Decoded  Image  Using  Two- 
Channel  Decoding. 
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(1)  The  original  unfiltered  subject  as  viewed  on  the 
monitor, 

(2)  A blur-coded  photograph, 

(3)  A simulated  decoded  image  using  one-channel 
coding  and  decoding,  and 

(4)  A simulated  decoding  image  using  two-channel 
coding  and  decoding. 

The  blurred  picture  was  simulated  by  using  incoher- 
ent correlation.  The  blurring  is  equivalent  to  convolving  the 
test  transparency  with  a disk  2 .2  mm  in  diameter.  This  is  ex- 
plained in  Appendix  II.  Comments  about  the  comparison  be- 
tween the  coded  and  decoded  image  in  each  case  are  made  below 

3.10.1  Test  Subject  No.  1.  (See  Figs.  12  and  13).  The  two- 
channel  scheme  shows  sharper  edges  around  windows.  The  gen- 
eral shape  of  the  tower  is  better  defined. 

3.10.2  Test  Subject  No.  2.  (See  Figs.  14  and  15).  In  the  two- 
channel  decoded  image,  certain  edges  of  the  building  facade 
show  that  are  missing  in  the  one-channel  decoded  image. 
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Notice  also  that  some  of  the  window  bracing  is  starting  to 
appear  in  the  two-channel  version.  There  is  also  better  con- 
trast in  the  water  ducts. 

3.10.3  Test  Subject  No.  3.  (See  Figs.  16  and  17).  All  of  the 
structural  edges  and  lines  are  sharper  in  the  two-channel  case. 
The  links  in  the  cahin  structure  are  also  visible. 

3.10.4  General  Observations . In  all  subjects  line  and  edge 

structure  is  improved.  This  agrees  well  with  observations 

29 

made  by  Ragnarsson  on  results  using  a one-channel  filter  in 

deblurring.  He  discusses  the  unavoidable  "ghost  images"  a- 

round  sharp  edges.  This  edge  degrading  effect  is  analogous  to 

the  ghosts  that  occur  in  a modulated  pulse  train  or  due  to  faults 
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in  ruled  diffraction  grating.  As  seen  from  Fig.  9(a),  the 
spectrum  is  modulated  by  a "circular  grating."  This  grating  is 
not  perfect  since  the  line  widths  and  spacings  vary.  This  leads 
to  edge  ghosts  which  are  analogous  to  the  ghost  sidebands  of 
ruled  gratings.  It  is  this  effect  that  can  be  most  effectively 
removed  using  multichannel  filtering  on  deblurring. 


CHAPTER  4 

CONCLUSIONS  AND  SUGGESTIONS 
FOR  FUTURE  RESEARCH 

The  interesting  results  in  Chapter  3 not  only  sug- 
gest immediate  applications,  but  also  offer  a basis  for  further 
exploration.  The  conclusions  that  follow  from  these  results 
are  discussed  here.  Also,  certain  ideas  that  occurred  during 
this  research,  but  not  yet  pursued,  are  proposed. 

4.1  CONCLUSIONS 

A new  and  novel  idea,  multichannel  image  decoding, 
has  been  presented.  This  scheme  is  quite  general  and  has 
been  tested  for  the  specific  case  of  a blur-coded  image.  It 
has  been  shown  (using  a graphical  analysis)  that  in  theory 
a two-channel  code  can  provide  nearly  37%  more  information 
in  the  frequency  plane  using  an  inverse  filter  with  a dynamic 
range  of  100.  Furthermore,  it  is  expected  from  this  analysis 
that  the  degrading  effects  due  to  the  information  gaps  near 
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nulls  in  the  blur-coded  transfer  function  can  be  eliminated. 

The  optical  simulation  of  Chapter  3 shows  that 
the  most  detrimental  effects  of  the  information  gaps  in  blur 
coding  is  "ghosting"  of  edges.  Also,  it  is  shown  that  there 
is  a definite  improvement  in  edge  and  line  structure  if  two- 
channel  decoding  is  used  instead  of  the  conventional  one- 
channel  decoding  scheme.  It  can  be  expected  from  these  results 
that  multichannel  filtering  should  improve  the  present  "state 
of  the  art"  in  inverse  filtering  schemes  where  the  coded  image 
has  high  signal- to-noise  ratio  in  the  recording  process. 

It  is  also  obvious  from  the  results  shown  that  other 
coding  schemes  that  are  similar  to  blur  coding  will  also  show 
improvement  through  multichannel  decoding.  "Similar" 
means  codes  that  have  coding  transfer  functions  with  periodic 
or  nearly  periodic  nulls,  such  as  the  coding  transfer  function 
for  motion  blur. 

Also  it  it  ght  be  noted  that  the  same  graphical 
analysis  used  in  Chapter  3 is  also  applicable  if  the  transfer 
function  is  circularly  symmetric  or  varies  in  only  one  direction 
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in  the  frequency  plane.  This  represents  a small  class  of 
functions,  but  it  is  an  important  class  in  optical  applications. 
Besides  extending  the  analysis  to  other  functions,  the  user 
can  easily  extend  it  to  cover  more  channels.  This  requires  only 
the  use  of  more  graph  overlays.  This  graphical  approach  is 
easy  to  use  and  is  interactive  since  it  allows  the  user  to  see 
the  composite  transfer  function  and  make  intuitive  adjust- 
ments . 

There  are  disadvantages  in  the  multichannel 
decoding.  It  requires  more  than  one  coding  channel  and  hence 
more  recording  and  information  processing.  Also,  there  is  no 
general  way  to  decide  the  best  way  to  carry  out  the  coding 
process.  Its  usefulness  will  depend  on  the  given  situation 
as  to  whether  it  is  worth  the  additional  effort. 

It  can  be  expected  that  certain  applications  can 
immediately  benefit  from  these  results.  The  particular  case 
of  misfocus  blurring  is  applicaole  to  electron  micrographs 
where  phase  objects  are  purposely  misfocussed  to  make  an 
intensity  recording.  Also,  in  aperture  coded  imaging  where 


a circular  aperture  is  used,  the  same  coding  transfer  function 
occurs  and  the  analysis  of  Chapter  3 is  applicable. 


4.2  SUGGESTIONS 


Several  interesting  ideas  have  arisen  that  unfor- 
tunately could  not  be  pursued.  Hopefully,  this  work  will 
create  enough  interest  to  see  that  they  are  carried  out.  The 
primary  problem  with  multichannel  filtering  lies  in  its  imple- 
mentation. 


The  easiest  technique  for  applying  multichannel 
filtering  involves  the  use  of  a digital  computer.  Each  coding 
channel  can  be  Fourier  transformed  using  a two-dimensional 
fast  Fourier  transform  algorithm . Then  for  a given  point  in  the 
frequency  plane,  the  computer  can  select  which  channel  op- 
timizes the  signal- to-noise  ratio.  The  particular  frequency 
plane  point  is  then  decoded  using  inverse  filtering.  All  this  is 
quite  obvious  and  straightforward;  however,  it  is  not  obvious  how 
to  carry  out  such  a procedure  optically.  Although  it  is  quite 
easy  to  obtain  the  Fourier  transform  of  any  given  coded  image 
using  a lens,  it  is  not  easy  to  select  pieces  from  each  transform 
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and  combine  them  into  a single  transform  to  get  a decoded 
image.  In  principle,  such  a process  is  possible.  Each 
channel  could  be  transformed  using  a lens;  a binary  filter  in 
the  transform  plane  could  select  those  parts  of  the  transform 
for  each  channel  which  were  important  in  recovery;  then 
the  separate  pieces  could  be  brought  together  using  mirrors 
to  form  the  Fourier  transform  of  an  image  coded  with  the 
composite  coding  function.  The  composite  inverse  filter  can  be 
made  holographically  from  each  piece  of  the  composite  trans- 
form using  any  of  the  conventional  holographic  deconvolution 
techniques . 

There  are  obvious  difficulties  with  this  scheme. 

Each  piece  in  the  mosaic  forming  the  composite  coding  trans- 
form must  be  phase-matched  with  pieces  contiguous  to  it. 

This  may  not  be  easy  if  many  channels  are  used.  If  only 
two  channels  are  used,  then  an  optical  phase  shifter  in  one 
channel  could  be  adjusted  until  the  best  decoded  image  was 
observed.  With  many  channels  it  would  be  difficult  to  ad- 


just the  phase  of  each  channel  independently. 
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In  addition  to  the  problems  cited  above,  the  scaling, 
size,  and  position  of  all  the  filters  and  the  input  transpar- 
encies are  critical.  Therefore,  it  appears  that  alternate  schemes 
need  to  be  developed.  Tt  certainly  looks  more  feasible  to 

record  the  coded  images  on  the  same  film  and  use  some  scheme 

54 

to  separate  them  optically,  such  as  grid-coding  techniques. 

Besides  the  implementation  problems , a great  deal 
more  research  is  needed  in  creating  new  coding  schemes. 

There  are  many  transfer  functions  that  can  complement  each 
other  and  improve  the  overall  signal-to-noise  ratio.  The  work 
here  represents  only  a small  effort. 

Since  the  computer  can  be  used  directly  to  implement 
multichannel  decoding,  it  should  be  tried  as  soon  as  possible 
on  "real  world"  problems  such  as  improvements  on  electron 
micrographs.  The  additional  information  certainly  appears 
worth  the  effort,  as  shown  in  the  simulation.  If  such  results 
can  be  achieved  in  practice,  then  an  improvement  in  the 
resolution  of  the  electron  microscope  for  phase  objects  is 


possible. 


APPENDIX  1 


PRODUCTION  OF  A TRANSPARENCY  WITH  AN  E- FIELD 
TRANSMITTANCE  PROPORTIONAL  TO  A GIVEN 
INTENSITY  DISTRIBUTION 


24 

Tsujuichi  has  shown  it  is  possible  to  record  an 
E-field  amplitude  transmittance  on  photographic  film  that  is 
directly  proportional  to  a given  object  intensity  if  the  contrast 
in  the  recorded  object  is  low.  A low  contrast  object  intensity 
distribution  across  the  x-y  plane  is  described  by 
o (x,  y)  + a 

where  o (x,  y)  represents  small  variations  in  the  recording 
about  a large  constant  background  a.  The  final  recorded  in- 
tensity transmittance  in  a photographic  positive  made  from  the 
intensity  distribution  is  T^,  where 

Tj  a Jo  (x,  y)  + aj  k, 

and  k is  a constant  that  is  equal  to  the  product  of  the  photo- 

graphic  gammas  used  in  making  the  original  negative  and  the 

42 

final  positive  transparency.  Note  that  E-field  transmittance 
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APPENDIX  II 

USING  INCOHERENT  CONVOLUTION  TO  CREATE 
A BLUR- CODED  IMAGE 


An  aperture  coded  imaging  system,  as  shown  in 
Fig.  18,  can  be  used  to  create  a blur-coded  image.  Misfocus 


blur  is  equivalent  to  convolution  with  a circular  disk.  In  Fig.  18 

i 

a subject  transparency  is  diffusely  illuminated  by  incoherent 
light.  Any  point  source  on  the  transparency  projects  an  image 
of  the  circular  coding  aperture.  The  coding  aperture  has  a 
diameter  DA,  while  the  projected  impulse  response  on  the  film 
has  a diameter  D^  . From  the  geometry: 

*1  + f2 

df  “ -77—  V K-1’ 

Therefore,  for  a given  subject  intensity  distribution  I(Xj  , y^), 
the  projected  intensity  distribution  is  ^ proportional  to 


+The  "circ"  function  is  defined  as 


• \ 2 2 
circ  \ \/  x + y 


1 if  ^yx2  + y2  S 1 
0 if  \fiF+  y2  > 1 
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£2  “ ~2  “/  \ ~F 

in  the  film  plane.  Note  that  the  projected  image  I in  the  con- 
volution is  scaled  by  7 j^.  This  can  be  seen  by  considering 

the  case  for  a small  value  of  D^,  then  the  "circ"  function  be- 
comes a Dirac  6 -function  and  the  system  acts  as  a simple  pin- 
hole camera.  If  the  original  subject  Kx^  y^  is  to  be  blurred 
by  coding  it  with  a disk  of  diameter  Dq,  then  the  projected  image, 
in  order  to  have  an  equivalent  amount  of  blur,  must  be  con-.'  >lved 
with 


Do' 


therefore , 


Dt 


— — D 
*1  ° 


but  using  ( 1-1 ) gives 


D 


(II- 2 ) 


Using  Eq.  (II- 2) , the  correct  diameter  of  the  coding  aperture  can 
be  determined  for  a projected  blurred  image  if  the  size  disk  that 
the  subject  transparency  is  to  be  convolved  with  is  known 
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(i.e. , D ) . In  Chapter  3,  D — 2.2  mm. 
o o 

The  aperture  coding  operation  shown  in  Fig.  18  was 
carried  out  using  a photographic  enlarger.  The  enlarging  lens 
was  replaced  with  the  correctly  scaled  circular  stop.  A neg- 
ative of  one  of  the  test  subject  transparencies  was  placed  in 
the  enlarger  and  adjusted  for  the  scale  to  be  used  in  printing 
with  the  enlarging  lens.  The  correctly  adjusted  stop  was  then 
installed  and  used  to  obtain  an  enlarged  blur  coded  image 


directly  on  print  paper. 


T 


REFERENCES 


1.  Hunt,  B.  R. , "Digital  Image  Processing, 11  Proceedings 
of  IEEE,  Vol.  63,  1975,  p.  693. 

2.  Hsu,  M.  P. , Fourier  Analysis , Simon  and  Schuster,  New 
York,  1970. 

3.  Bracewell,  R.  N.,  The  Fourier  Transform  and  Its  Applica- 
tions , McGraw-Hill  Book  Company,  New  York,  1965. 

4.  Lighthlll,  M.  J. , Introduction  to  Fourier  Analysis  and 
Generalized  Functions,  Cambridge  University  Press, 

New  York,  1960. 

5.  Papoulis,  A.,  The  Fourier  Integral  and  Its  Applications . 
McGraw-Hill  Book  Company,  New  York,  1962. 

6.  Bragg,  W.  L. , "A  New  Type  of  X-Ray  Microscope," 

Nature,  Vol.  143,  1939,  p.  678. 

7.  Bragg,  W.  L. , "The  X-Ray  Microscope,"  Nature,  Vol. 

149,  1942,  p.  470. 

8.  Gabor,  D.,  "A  New  Microscope  Principle,  " Nature,  Vol. 
161,  1948,  p.  777. 

9.  Gabor,  D.,  "Microscopy  by  Reconstructed  Wavefronts," 
Proceedings  of  the  Royal  Society.  Vol.  A197,  1949,  p.  454. 

10.  Phillips,  W.  R.,  and  D.  McLachlan,  Jr.,  "A  Versatile 
Projector  for  Assisting  in  Crystal  Structure  Determinations,  " 
Review  of  Scientific  Instruments , Vol.  25,  1954,  p.  123. 

11.  Rogers,  G.  L. , "The  Black  and  White  Hologram,"  Nature, 
Vol.  166,  1950,  p.  1027. 


87 


88 


12.  Rogers,  G.  L. , "Gabor  Diffraction  Microscopy:  The 
Hologram  as  a Generalized  Zone  Plate,  " Nature , Vol. 

166,  1950,  p.  237. 

13.  Mertz,  L.,  Transformations  in  Optics,  John  Wiley  and 
Sons,  Inc.,  New  York,  1965. 

14.  Young,  N.  O. , "Photography  Without  Lenses  or  Mirrors," 
Sky  and  Telescope.  Vol.  26,  1963,  p.  8. 

15.  Barrett,  H.  H. , and  D.  T.  Wilson,  "Fresnel  Zone  Plate 
Imaging  in  Radiology  and  Nuclear  Medicine, " Optical 
Engineering,  Vol.  12,  1963,  p.  8. 

16.  Rogers,  W.  L. , I.  W.  Jones,  and  W.  H.  Beierwaltes , 
"Imaging  in  Nuclear  Medicines  with  Incoherent  Holog- 
raphy , " Optical^ngineerir^  Vol.  12,  1973,  p.  13. 

17.  Barrett,  H.  H. , and  F.  A.  Harrigan,  "Fresnel  Zone  Plate 
Imaging  of  Gamma  Rays , " Applied  Optics , Vol.  12,  1973, 

p.  2686. 

18.  Dicke,  R.  H. , "Scatter  Hole  Cameras  for  X-Rays  and 
Gamma  Rays,"  Astro.  Phys.  Journal,  Vol.  153,  1968, 
p.  L101 . 

19.  Groh,  G. , G.  S.  Hayat,  and  G.  W.  Stroke,  "X-Ray 

and  y-Ray  Imaging  with  Multiple  Pinhole  Cameras  Using 
a Posteriori  Image  Synthesis,"  Applied  Optics,  Vol.  11, 
1972,  p.  921. 

20.  Weiss,  H. , "Nonredundant  Point  Distribution  for  Coded 
Aperture  Imaging  with  Application  to  Three-Dimensional 
On-Line  X-Ray  Information  Retrieval,  " IEEE  Transactions 
on  Computers , Vol.  C-24,  1975,  p.  391. 

21.  Goley,  M.  J.  E.,  "Point  Arrays  Having  Compact,  Non- 
redundant Autocorrelations,  " Journal  of  the  Optical  Society 
of  America,  Vol.  61,  1971,  p.  273. 


89 


22.  Wouters,  A.,  K.  A.  Simon,  and  J.  G.  Huschberg,  "Direct 
Method  of  Decoding  Multiple  Images  , " Applied  Optics  , 
Vol.  12,  1973,  p.  1871. 

23.  Marechal,  A.,  P.  Croce,  and  K.  Dietzel,  "Amelioration 
Du  Contraste  Des  Details  Des  Images  Photographiques 
Por  Filtage  Des  Frequences  Spatiales,  " Optica  Acta , 

Vol.  5,  1958,  p.  256. 

24.  Tsujuichi,  J. , "Correction  of  Optical  Images  by  Compen- 
sation of  Aberrations  and  by  Spatial  Frequency  Filtering, " 
in  E.  Wolf  (ed.)  Progress  in  Optics,  Vol.  II,  North- 
Holland  Publishing  Company,  Amsterdam. 

25.  Tsujuichi,  J.,  and  G.  W.  Stroke  , "Optical  Image  De- 
blurring Methods, " Proceedings  of  U.S. -Japan  Seminar 
on  Information  Processing  by  Holography,  in  Barrekette 
et  al  (ed.).  Applications  of  Holography,  p.  259,  Plenum 
Press , New  York. 

26.  Stroke,  G.  W.  , and  R.  G.  Zech,  "A  Posteriori  Image 
Correcting  Deconvolution  by  Holographic  Fourier- Trans- 
form  Division,  " Physics  Letters,  Vol.  25A,  1967,  p.  88. 

27.  Stroke,  G.  W. , "Image  Deblurring  and  Aperture  Synthesis 
Using  a Posteriori  Processing  by  Fourier- Trans  form  Holog- 
raphy ,"  0]3tica_Acta,  Vol.  16,  1969,  p.  401. 

28.  Stroke,  G.  W. , and  M.  Halioua,  "A  New  Holographic 
Image  Deblurring  Method,"  Physics  Letters,  Vol.  29A, 
1972,  p.  269. 

29.  Ragnarsson,  S.  I.,  "A  New  Holographic  Method  of  Gen- 
erating a High  Efficiency  Extended  Range  Spatial  Filter 
with  Applications  to  Restoration  of  Defocussed  Images,  " 
Physlca  Scripta,  Vol.  2,  1970,  p.  2. 


90 


30.  Tichenor,  D.  A.,  "Extended  Range  Spatial  Filters  for 
Image  Deblurring,  " Dissertation  at  Stanford  University 
in  Electrical  Engineering,  1973,  available  from  Univer- 
sity Microfilms  #73-27,128. 

31.  Harris,  Sr.,  J.  L. , "Image  Evaluation  and  Restoration," 
Tournal  of  the  Optical  Society  of  America , Vol.  56,  1966, 
p.  569. 

32.  Harris,  Sr.,  J.  L. , "Potential  and  Limitations  of  Tech- 
niques for  Processing  Linear  Motion  Degraded  Imagery,  " 
in  Evaluation  of  Motion  Degraded  Images,  p.  131,  U.S. 
Government  Printing  Office,  Washington,  D.C.,  1968. 

33.  Horner,  J.  L. , "Optical  Spatial  Filtering  with  the  Least 
Mean-Square-Error  Filter,  " Journal  of  the  Optical  Society 
of  America , Vol.  59,  1969,  p.  553. 

34.  Stockham,  T.  G. , T.  M.  Cannon,  and  R.  B.  Ingebretson, 
"Blind  Deconvolution  Through  Digital  Signal  Processing," 
Proceedings  of  IEEE,  Vol.  63,  1975,  p.  678. 

35.  Sondhi,  M.  M.  , "Image  Restoration:  The  Removal  of 
Spatially  Invariant  Degradation,"  Proceedings  of  IEEE, 

Vol.  60,  1972,  p.  842. 

36.  Huang,  T.  S.,  W.  F.  Schreiber,  and  O.  J.  Tretiak, 

"Image  Processing,"  Proceedings  of  IEEE,  Vol.  59,  1971, 
p.  1586. 

37.  Oppenheim,  A.  V.,  R.  W.  Schafer,  and  T.  G.  Stockham, 
"Nonlinear  Filtering  of  Multiplied  and  Convolved  Signals," 
Proceedings  of  IEEE,  Vol.  56,  1968,  p.  1264. 

38.  Ratcliffe,  J.  A. , "Some  Aspects  of  Scalar  Diffraction 
Theory  and  Their  Application  to  the  Ionosphere, " in 
Reports  on  Progress  in  Physics,  (A.  C.  Strickland,  ed.) 
Vol.  XIX,  p.  188,  The  Physical  Society,  London,  1956. 


91 


39.  Collier,  R.  J. , C.  B.  Burckhardt,  and  L.  H.  Lin,  Optical 
Holography,  Academic  Press,  New  York,  1971. 

40.  Cathey,  W.  T. , Optical  Information  Processing  and 
Holography,  John  Wiley  and  Sons,  New  York,  1974. 

41.  Bom,  M.,  and  E.  Wolf,  Principles  of  Optics , Pegamon 
Press,  New  York,  1965. 

42.  Goodman,  J.  W. , Fourier  Optics , McGraw-Hill  Book 
Company,  New  York,  1968. 

43.  Sommerfield , A.,  Optics , Academic  Press,  New  York, 
1967. 

44.  Baker,  B.  B. , and  E.  T.  Copson,  The  Mathematical 
Theory  of  Huggens  Principle , Clarendon  Press,  Oxford, 
England,  1950. 

45.  Silver,  S.  S.,  "Microwave  Aperture  Antennas  and  Diffrac- 
tion Theory,  Journal  of  the  Optical  Society  of  America, 

Vol.  52,  1962,  p.  131. 

46.  Vander  Lugt,  A.,  and  R.  H.  Mitchel,  "Technique  for 
Measuring  Modulation  Transfer  Functions  of  Recording 
Media , " Journal  of  the  Optical  Society  of  America , Vol . 
57,  1967,  p.  372. 

47.  Kodak  Plates  and  Films  for  Scientific  Photography,  East- 
man Kodak  Company,  19 

48.  Lash,  H. , Vector  and  Tensor  Analysis , McGraw-Hill 
Book  Company,  New  York,  1950. 

49.  Helstrom , C.  W. , "Image  Restoration  by  the  Method  of 
Least  Squares , " Journal  of  the  Optical  Society  of  America , 
Vol.  57,  1967,  p.  297. 

50.  Horner,  J.  L.,  "Optical  Restoration  of  Images  Blurred  by 
Atmospheric  Turbulence  Using  Optimum  Filter  Theory,  " 
Applied  Optics,  Vol.  9,  1970,  p.  167. 


92 


51.  Hopkins,  H.  H.,  "The  Frequency  Response  of  a Defo- 
cus sed  Optical  System,  " Mathematics  and  Physics 
Proceedings  of  the  Royal  Society,  London,  Vol.  231A, 
1955,  p.  91. 

52.  Private  communication  from  D.  H.  Williams,  Department 
of  Electrical  Engineering,  The  University  of  Texas  at 
Austin,  Austin,  Texas. 

53.  Stuart,  R.  D. , An  Introduction  to  Fourier  Analysis, 
Methuen  and  Company,  Ltd.,  1969. 

54.  Pennington,  K.  S. , P.  M.  Will,  and  G.  L.  Shelton, 

"Grid  Coding:  A Technique  for  Extraction  of  Differences 
from  Scenes,"  Optical  Communication,  Vol.  2,  1970, 

p.  113. 


PflPW 


r>-  V 1 f 

f ;unqia§sjfied J 

HCIH'TY  CLASSIFICATION  or  THIS  PAOC  (WIMr  Polo  lww4» 

f REPORT  DOCUMENTATION  PAGE 


I.  GOVT  ACCESSION  NO. 


>‘F0SR  - TR-  7 7-  OOP  9 


1 4.  TITLE  (ond  Subtitle) 


MULTICHANNEL  IMAGE  DECODING 


1.  AUTHOR?*) 

Jerome  Knopp 
Elmer  L.  Hixson 

t.  performing  onoanization  name  and  aoorcss 

Electronics  Research  Center 
The  University  of  Texes  at  Austin 

Austin,  Texas  7871? 

ii.  controlling  office  name  and  address 

AF  Office  of  Scientific  Research  (NE) 

Soiling  AFB  DC  20332 

Tf  MONITORING  AGENCY  NAME  • kOOntStflt  dltlotont  Ira*  Controlling  OlHco) 


• S.  OISTRIGuTlON  STATEMENT  (ol  Nil*  Roporl) 


Approved  for  public  release;  distribution  unlimited. 


I 17.  OISTRIGuTlON  STATEMENT  (ol  the  aktlrmcl  win od  In  Slack  JO,  ll  dllloronl  horn  Report) 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 

1 RECIPIENT'S  CATALOG  NUMBER 


S.  TYRE  OR  REPORT  A PERlOO  COVEREO 


S.  PERFORMING  ORG.  REPORT  NUMBER 


contract  or  grant  number^; 


Cont.  F44620-71-C-0091 

10  PROGRAM  CLEMENT.  PROJECT.  TASK 
AREA  A WORK  UNIT  NUMBERS 

4751  61 102F  681306 

it.  report  date 

January  15,  1976 

13.  NUMBER  OF  PAGES 

95 

IS.  SECURITY  CLASS,  (ol  into  lop ort) 


UNCLASSIFIED 


ISa.  DECLASSIFICATION'  DOWNGRADING 
SCHCOULE 


Its.  supplementary  notes 


IS.  KEY  WORDS  (Continue  on  toroeeo  oldo  II  nocooooor  Identity  6 y block  nmbor) 

Optical  Processing  Multichannel  Decoding 

Decoding 

Deblurring 

Image  Restoration  

JO.  ABSTRACT  (Conllnuo  on  rororoo  oldo  II  nooooom y ond  Idomllty  by  block  mmbot) 

Multichannel  image  decoding  is  a very  general  scheme  to  improve  the  signal- 
to-noise  ratio  in  decoding  images  coded  with  linear  shift  invariant  codes.  It  is 
shown  that  it  can  be  advantageous  to  code  an  image  with  more  than  one  code. 

A "composite"  inverse  filter  can  then  be  used  in  the  frequency  plane  to  recover 
the  Fourier  transform  of  the  original  image.  To  recover  a particular  point  in  the 
frequency  plane,  the  inverse  filter  for  any  one  of  the  coded  versions  of  the 


DD  1473  COITION  OF  • NOV  AS  IS  OBSOLETE 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Dole  intend) 


Image,  that  Is  any  channel,  can  be  used.  The  channel  with  the  highest  signal- 
to-noise  ratio  is  used  to  recover  the  desired  point.  A particular  application 
of  this  scheme  is  examined.  A two-channel  code  is  compared  with  a one- 
channel  code  in  the  frequency  domain  for  the  case  of  mlsfocus  blurring.  A 
graphical  analysis  is  given  which  compares  the  distance  in  the  frequency  plane 
up  to  the  first  zero  in  the  restored  transfer  function  for  one-  and  two-channel 
deblurring.  Binary  plots  of  the  restored  transfer  functions  for  a dynamic  range 
of  100  are  shown  for  the  two  different  coding  schemes.  These  plots  show  that 
the  two-channel  code  recovers  37%  more  area  in  the  frequency  plane  than  the 
one-channel  code.  This  increased  area  restores  information  missing  near 
zeros  in  the  one- channel  transfer  function.  An  optical  simulation  was  made 
using  the  binary  plots  as  frequency  plane  filters.  Using  photographs  of  subject 
with  a significant  amount  of  line  and  edge  structure.  It  is  shown  that  the  two- 
channel  code  results  in  "sharper"  decoded  Images. 


UNCLASSIFIED 


